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(g) Image stabiliser for video camera. 

(57) A video signal processing apparatus for cor- 
recting vibration effects in a video camera that 
has a CCD image pickup device having a num- 
ber of lines greater than the number of lines of 
the standard NTSC television system. The lines 
used to generate the image are shifted during 
the vertical blanking interval to correct for vib- 
rations of the video camera, and the overflow 
charges which are caused by transferring the 
CCD image pickup device at a high speed dur- 
ing the blanking period are absorbed into a 
semiconductor drain element arranged in paral- 
lel with the horizontal transfer register of the 
CCD image pickup device. Defective pixels in 
the image pickup device are compensated by 
storing the addresses of defective pixels and 
interpolating at those positions, during vib- 
ration correction the addresses of the defective 
pixels are shifted to correspond to the amount 
of vibration correction. A read clock and a write 
dock for the line memory that is used to per- 
form the vibration correction in the horizontal 
direction are set to line-locked dock signals of 
different frequencies, thereby preventing de- 
terioration of the picture quality upon vibration 
correction. The window used to detect optical 
information for automatic camera control is 
also shifted in accordance with the shift amount 
used to perform vibration correction. 
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The present invention relates generally to a video 
signal processing circuit used in performing vibration 
correction for a video camera and, more particularly, 
to providing defective pixel compensation and optical 
detector window adjustment in accordance with the 
vibration correction. 

In recent years, the realization of a miniature 
light-weight video camera has progressed and today 
such a video camera can be fairly easily handled. On 
the other hand, in association with the miniaturization 
and lowered weight of the video camera, the video 
camera can be so easily moved that the photograph- 
ing operation is readily influenced by camera move- 
ment and vibration. A video camera, therefore, having 
a vibration correcting feature has been proposed and 
put into practical use. 

As a vibration correcting system for a video cam- 
era, there has been proposed a circuit in which an im- 
age pickup signal from an image pickup device is stor- 
ed in a field memory, and the picture plane is en- 
larged and interpolated in the field memory. The read- 
ing out operation from the field memory is controlled 
in accordance with the vibration of the camera, and 
the vibration is corrected. Such a system is disclosed 
in U S. patent application serial number 673,783 as- 
signed to the present applicant. Nevertheless, when 
the picture plane is enlarged and interpolated as de- 
scribed above, the resolution deteriorates. 

There has also been proposed a mechanism in 
which a variable optical axis prism is arranged in front 
of a lens, the prism is moved in accordance with the 
vibrations of the camera, the refraction angle of the 
incident light is changed, and the vibration is compen- 
sated Such a system is disclosed in Japanese patent 
application number Hei 04-016968. According to such 
a vibration correcting mechanism, because the pic- 
ture plane is not enlarged and interpolated, the picture 
quality is not deteriorated. Nevertheless, according to 
such a vibration correcting mechanism the variable 
optical axis prism must be mechanically moved. 
Therefore, the required mechanical structure be- 
comes an obstacle to realizing a small sized and light- 
weight camera. 

Further, there has been proposed a system in 
which the image pickup device of the camera has a 
number of lines greater than the number of lines of 
the standard television system, the picture plane is 
vertically moved by using the surplus lines which are 
available, and the vibration is corrected. This system 
is disclosed in U.S. patent application serial number 
978,366 also assigned to the present applicant. 

In this latter system, for instance, a CCD image 
pickup device of the PAL system is used to outputthe 
video signal of the NTSC system. When the video sig- 
nal of the NTSC system is generated by using the 
CCD image pickup device of the PAL system, be- 
cause the number of lines of the PAL system is great- 
er than the number of lines of the NTSC system, sur- 



plus lines are provided. The number and location of 
the lines in the CCD image pickup device is transfer- 
red at a high speed during the vertical blanking peri- 
od. By changing the numberof lines in the high-speed 
5 transfer with respect to the number of lines before and 
after the video frame time, the picture plane can be 
vertically moved. 

Nevertheless, when such a vibration correction 
using an increase in CCD lines is executed, the high- 
10 speed transfer is executed during the blanking period, 
so that considerably large charges must flow from a 
vertical transfer register into a horizontal transfer reg- 
ister of the CCD image pickup device. Consequently, 
there occurs the problem that when a strong light is 
15 irradiated onto the CCD image pickup device, the 
charge amount exceeds the capacity of the horizontal 
transfer register and the overflow charges reverse 
flow into the vertical transfer register side. 

Moreover, as a practical matter defective pixels 
20 are always included in the pixels of a CCD image pick- 
up device. Hitherto, position information of the defec- 
tive pixels is stored in a memory and processes such 
as interpolation and the like are executed at the pos- 
itions of the defective pixels, thereby coping with the 
25 defective pixels. 

As described above, when the image pickup de- 
vice having a numberof lines greater than the number 
of lines of the standard television system is used vi- 
bration correction is executed by vertically moving 
30 the picture plane by using the surplus lines which are 
available. Therefore, because the defective pixel in- 
formation is fixed as addresses in a memory, when 
the video signal is moved to perform vibration correc- 
tion the positions of the detective pixels do not corre- 
35 spond to the positions at which the defect correction 
is to be executed. 

When the image pickup device in which the num- 
ber of lines is larger than the number of lines of the 
standard television system is used, the vertical height 
40 of the image pickup picture plane is increased. There- 
fore, the image pickup signal is stored in a iif?e mem- 
ory and is time-base converted in accordance with a 
magnif ication ratio. By such time-base converting the 
image pickup signal, the picture plane is enlarged in 
45 the horizontal direction. Therefore, by shifting the en- 
larged picture plane in accordance with a vibration 
amount in the horizontal direction, the vibration in the 
horizontal direction can be corrected . 

In performing the time-base conversion by using 

so the line memory as mentioned above, there is consid- 
ered a method whereby a write clock signal, and a 
read clock signal are set to the same clock and the 
same data is read out a plurality of times in accor- 
dance with the magnification ratio. After such multiple 

55 read out, the data is interpolated by an interpolation 
filter, however, when the interpolation filter is used 
the picture quality deteriorates. 

' Some video cameras have a window to detect 
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optical information for performing automatic expos- 
ure control and automatic focus control. For example, 
automatic exposure control is executed by detecting 
a video signal level using the detection window and 
by setting an opening amount of an iris and a gain of 
an automatic gain control circuit (AGC) in accordance 
with the video signal level. As mentioned above, 
when the image pickup signal is stored in the line 
memory, the picture plane is enlarged in the horizon- 
tal direction, the enlarged picture plane is shifted in 
accordance with a vibration amount in the horizontal 
direction, and the vibration in the horizontal direction 
is corrected. Thus, the position of the window is de- 
viated relative to the position of an object to be pho- 
tographed. For example, when the position of the win- 
dow coincides with the position over the object or is 
moved away therefrom due to vibration, although the 
amount of light in the window changes, the photo- 
graphed picture plane is stationary due to the vibra- 
tion correction. Therefore, a phenomenon occurs in 
which the brightness changes in spite of the fact that 
the picture plane is stationary. 

Therefore, one object of the present invention is 
to provide a video signal processing apparatus that 
can prevent the reverse flow of charges to a vertical 
transfer register of an image pickup device when per- 
forming vibration correction. 

It is another object of the present invention to pro- 
vide a video signal processing apparatus that can 
make the actual positions of defective pixels in a vid- 
eo camera image pickup device correspond to the 
position of defective pixels after an image plane has 
been shifted due to performing vibration correction. 

It is a still further object of the present invention 
to provide a video signal processing apparatus that 
does not cause deterioration of the picture quality 
when a time-base conversion in the horizontal direc- 
tion is executed when performing video camera vibra- 
tion correction. 

It is another object of the present invention to pro- 
vide a video signal processing apparatus for a video 
camera in which optical information is obtained from 
a window adapted to the picture plane to be actually 
photographed. 

According to an aspect of the present invention, 
there is provided a video signal processing apparatus 
for correcting vibrations in a video camera, compris- 
ing: an image pickup having a number of lines in vert- 
ical direction that is larger than the number of lines of 
a television system to be output; a vibration amount 
detector for detecting a vibration amount in the verti- 
cal direction; a high-speed transfer control for trans- 
ferring the image pickup at a high speed during a 
blanking period within a range of the number of sur- 
plus lines which is equal to the difference between 
the number of lines of the image pickup and the num- 
ber of lines of the television system to be output in ac- 
cordance with the vibration amount in the vertical di- 



rection obtained by the vibration amount detector and 
for correcting the vibration in the vertical direction; 
and a charge back-flow preventing device, arranged 
5 in parallel with a horizontal transfer register of the im- 
age pickup, for preventing a back flow of charges to 
a vertical transfer register upon high-speed transfer of 
the charges on the image pickup. 

According to another aspect of the present inven- 
16 tion, there is provided a video signal processing ap- 
paratus for correcting vibration in a video camera, 
comprising: an image pickup having a number of lines 
in the vertical direction which is greater than the num- 
ber of lines of the television system to be output; a vi- 
15 bration amount detector for detecting a vibration 
amount in the vertical direction; a high-speed transfer 
control for transferring charges from the image pickup 
at high speed during a video blanking period within a 
range of the number of surplus lines that is equal to 
20 the difference between the number of lines of the im- 
age pickup and the number of lines of the television 
system to be output in accordance with the vibration 
amount in the vertical direction obtained by the vibra- 
tion amount detector and for correcting the vibration 
25 in the vertical direction; a memory for storing pixel de- 
fect location formation for each of the pixels that are 
arranged in the image pickup; and a defect corrector 
for correcting defects in accordance with the defect 
location information and the number of lines that are 
30 transferred at high speed for vibration correction, 
thereby correcting defects. 

According tostill another aspect of the present in- 
vention, there is provided a video signal processing 
apparatus for correcting vibrations in a video camera, 
35 comprising: an image pickup having a number of lines 
in the vertical direction that is greater than the num- 
ber of lines of the television system to be output; a vi- 
bration amount detector for detecting vibration 
amounts in the horizontal and vertical directions; a 
40 high-speed transfer control for transferring the 
changes on the image pickup at high speed during a 
video blanking period within a range of the number of 
surplus lines which is equal to the difference between 
the number of lines of the image pickup and the num- 
45 ber of lines of the television system to be output in ac- 
cordance with the vibration amount in the vertical di- 
rection obtained by the vibration amount detector and 
for correcting the vibration in the vertical direction; a 
line memory into which a video signal after the vibra- 
50 tion in the vertical direction is written and from which 
the video signal is read out by a read clock of a fre- 
quency lower than that of the write dock, thereby 
performing an enlargement in the horizontal direction 
of the video signal; and a line memory control for line- 
55 locking the write clock and the read clock, for setting 
a frequency ratio of the write dock and the read dock 
in accordance with a magnification ratio in the hori- 
zontal direction, for shifting the reading position or 
writing position of the line memory, thereby correct- 

3 
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ing the vibration in the horizontal direction. 

According to yet another aspect of the present in- 
vention, there is provided a video signal processing 
apparatus for correcting vibration in a video camera, 5 
comprising: a image pickup having a number of lines 
in the vertical direction that is greater than the num- 
ber of lines of the television system to be output; a vi- 
bration amount detector for detecting vibration 
amounts in the horizontal and vertical directions; a w 
high-speed transfer control for transferring the charg- 
es on the image pickup at high speed during a blank- 
ing period within a range of the number of surplus 
lines which is equal to the difference between the 
number of lines of the image pickup and the number 15 
of lines of the television system to be output in accor- 
dance with the vibration amount in the vertical direc- 
tion obtained by the vibration amount detector and for 
correcting the vibration in the vertical direction; a line 
memory into which a video signal after the vibration 20 
in the vertical direction is written and from which the 
video signal is read out by a read clock of a frequency 
lower than that of the write clock, thereby performing 
an enlargement in the horizontal direction of the video 
signal; a line memory control for correcting the vibra- 25 
tion in the horizontal direction by shifting a reading 
position or a writing position of the line memory; and 
a window setting circuit for setting a window to detect 
optical information and for correcting the position of 
the window in accordance with the vibration amount 30 
so as not to change the relative position for the video 
signal after the vibration has been corrected. 

The present invention will be further described by 
way of example in the following detailed description 
thereof, which is to be read in connection with the ac- 35 
companying drawings, in which:- 

Fig. 1 is a general block diagram of a video cam- 
era to which the present invention is applied; 
Fig. 2 is a representation of a CCD which is used 
in a video camera to which the invention is ap- 40 
plied; 

Figs. 3A to 3F are waveform diagrams which are 
useful in explaining the video camera to which 
the present invention is applied; 
Fig. 4 is a representation of a CCD which is useful 45 
in explaining the video camera to which the in- 
vention is applied; 

Figs. 5A and 5B are representations of a portion 
of a CCD which are useful in explaining the video 
camera to which the invention is applied; so 
Fig. 6 is a schematic of explain a CCD image pick- 
up device of the video camera to which the inven- 
tion is applied; 

Fig. 7 is a schematic of explain of a CCD image 
pickup device of the video camera according to 55 
an embodiment of the present invention; 
Fig. 8 is a representation of the CCD image pick- 
up device of the video camera of Fig. 7 shown in 
more detail; 



Fig. 9 is a block diagram explain the vibration cor- 
rection system for the horizontal direction of the 
video camera according to an embodiment of the 
present invention; 

Figs. 10Aand 10B are representations of a video 
frame which useful in explaining the correction of 
pixel defects of the video camera according to an 
embodiment of the present invention; 
Fig. 1 1 is a block diagram of a system for the cor- 
rection of defects of the video camera according 
to an embodiment of the present invention; 
Fig. 12 is a block diagram of a system for setting 
of a window for optical detection of the video cam- 
era according to an embodiment of the present in- 
vention; 

Figs. 13A to 13D are waveform diagrams which 
are useful in explaining the setting of the window 
for optical detection of the video camera as 
shown in Fig. 12; and 

Figs. 14A to 14C are representations of a video 
frame which are useful in explaining the setting of 
the window for optical detection of the videocam- 
era as shown in Fig. 12. 

In the video camera of Fig. 1 the light of an object 
image obtained through a lens 1 is formed as an im- 
age on a photosensitive surface of a CCD image pick- 
up device 3 after passing through an iris 2. Although 
the video camera is selected to perform recording fol- 
lowing the NTSC standard system, in order to per- 
form vibration correction the CCD image pickup de- 
vice 3 is provided with a number of lines that is not 
equal to the number of lines of the NTSC system but, 
rather, is equal to the number of lines of the PAL sys- 
tem. That is, the number of lines of the CCD image 
pickup device 3 is selected such that there are 582 ef- 
fective lines. 

The CCD image pickup device 3 is driven by a 
driver 4 on the basis of a timing signal from a timing 
generating circuit 5. A sync signal is supplied from a 
sync generating circuit 6 to the timing generating cir- 
cuit 5 and an output of a vibration correcting controller 
20 is also supplied to the timing generating circuit 5. 
A high-speed transfer clock signal is fed to the CCD 
image pickup device 3 for a period of time equal to the 
vertical blanking interval in accordance with the vi- 
bration in the vertical direction of the camera. 

According to an embodiment of the invention, pix- 
el defects in the CCD image pickup device 3 are cor- 
rected, and the defect information of the CCD image 
pickup device 3 is stored in a defect position memory 
31 . An output of the defect position memory 31 is sup- 
plied to a defect correction pulse generating circuit 32 
whose output is supplied to a signal processing circuit 
10. Atthe position of the defective pixel, the output of 
the CCD image pickup device 3 is replaced to pixel 
data formed by interpolating the data of the adjacent 
pixels. Due to this, the defect correction is executed. 
As will be explained hereinafter in performing defect 
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correction an address is shifted so that the defect 
position on the CCD image pickup device 3 corre- 
sponds to the position to correct position after the 
lines are shifted to perform vibration correction. 

The output of the CCD image pickup device 3 is 
supplied to an analog-to-digital (A/D) converter 9 
through a sample-and-hold circuit 7 and an automatic 
gain control (AGC) circuit 8. The image pickup signal 
is converted into a digital signal by the A/D converter 
9 and an output of the A/D converter 9 is supplied to 
the signal processing circuit 10 and is also supplied 
to an optical detector circuit 11. 

The signal processing circuit 10 executes neces- 
sary camera signal processing and forms a lumi- 
nance signal and a chrominance signal correspond- 
ing to the NTSC system from the image pickup signal 
from the CCD image pickup device 3. The luminance 
signal and the chrominance signal from the signal 
processing circuit 10 are supplied to a horizontal cor- 
recting circuit 14. 

The optical detector circuit 11 is provided to ob- 
tain information which is necessary for optical con- 
trols such as exposure control, focus control, white 
balance control, and the like. A window for obtaining 
this information is set by the optical detector 11 and 
a light level in the window is detected and a corre- 
sponding signal is supplied to a camera controller 13. 
The camera controller 1 3 controls the gain of the AGC 
circuit 8 and the opening size of the iris 2 in accor- 
dance with the light level signal, so that automatic ex- 
posure control is performed. The detection window is 
set by the optical detector 11 and an edge component 
level of the image pickup signal in the window is de- 
tected and supplied to the camera controller 13. The 
camera controller 13 controls the position of the lens 
1, the lens position control mechanism is not shown, 
so that the edge component level is maximized. In 
this way, the automatic focus control is executed. The 
position of the window of the optical detector 11 can 
be moved by a window correction circuit 12. 

According to an embodiment of the invention, the 
lines in the horizontal direction are enlarged by the 
line memory of the horizontal correcting circuit 14 and 
the reading position, or the writing position, in the line 
memory is shifted, thereby performing the vibration 
correction in the horizontal direction. When such a 
method is used, however, the position of the picture 
plane which is output does not coincide with the pos- 
ition of the picture plane photographed by the CCD 
image pickup device. Therefore, when the position of 
the window does not coincide with the position of the 
object due to the vibration correction, the light 
amount in the window changes, but the photographed 
picture plane appears stationary due to the vibration 
correction. Thus, a phenomenon occurs in which the 
brightness changes in spite of the fact thatthe picture 
plane is stationary. To overcome this, the invention 
provides a system whereby the position of the win- 



dow of the optical detector 11 is shifted in accordance 
with a vibration correction amount 

The luminance signal and the chrominance sig- 

5 nal from the signal processing circuit 1 0 are supplied 
to the horizontal correcting circuit 14, and the hori- 
zontal correction circuit 14 enlarges a signal of one 
line and shifts the reading position, thereby correct- 
ing the effects of vibration in the horizontal direction 

10 of the camera. The horizontal correcting circuit 14 is 
constructed by a line memory. A PLL 15 provides a 
synchronized read clock and write clock for the line 
memory. The reading and writing positions of the line 
memory forming the horizontal correctipn circuit 14 

15 are controlled by the vibration correcting controller 
20. 

The luminance signal and chrominance signal 
from the horizontal correcting circuit 14 are supplied 
respectively to D/A converters 16A and 16B and the 
20 analog luminance signal and chrominance signal are 
generated by the D/A converters 16Aand 16B and 
output from output terminals 17Aand 17B. 

The shaking of the video camera is detected by 
pitch and yaw angular velocity sensors 21 A and 21 B. 
25 That is, shaking in the vertical direction is detected by 
the pitch angular velocity speed sensor 21 A, and an 
output of the pitch angular velocity speed sensor 21A 
is supplied to an A/D converter 23A through an am- 
plifier 22A. An output of the A/D converter 23A is sup- 
30 plied to the vibration correcting controller 20. Shaking 
in the horizontal direction is detected by the yaw an- 
gular velocity sensor 21B and an output of the yaw 
angular velocity sensor 21 B is supplied to an A/D con- 
verter 23B through an amplifier 22B. The output of 
35 the A/D converter 23B is also supplied to the vibration 
correcting controller 20. 

The vibration correcting controller 20 controls a 
high-speed transfer of the CCD image pickup device 
3 by a signal fed to timing generator 5 on the basis of 
40 shaking in the vertical direction as detected by the 
pitch angular velocity sensor 21 A, thereby executing 
the vibration correction in the vertical direction. On 
the basis of shaking in the horizontal direction as de- 
tected by the yaw angular velocity sensor 21 B, the 
45 read position (or writing position) of the line memory 
constructing the horizontal correcting circuit 14 is 
shifted, thereby performing the vibration correction 
in the horizontal direction. 

- More specifically, as shown in Fig. 2A according 
so to the embodiment of the invention the CCD image 
pickup device 3 is formed of a device in which the 
number of lines is in accordance with the PAL system, 
so that the number of effective lines is equal to 582. 
On the other hand, the number of effective lines of 
55 the NTSC system is usually taken to be 494 lines. 
Therefore, 494 lines are selected from among the 582 
effective lines of one picture plane that are available 
in the CCD image pickup device 3. As shown by the 
upper and lower hatched regions in Fig. 2A, outputs 
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of these extraneous lines are not used. The picture 
plane can be moved in the vertical direction by chang- 
ing the start position ST. Therefore, by moving the 
start position ST so as to eliminate the shake in the 
vertical direction of the picture plane the vibration 
correction in the vertical direction can be executed. 

Figs. 3A-3F show the waveforms of the various 
signals applied to the CCD image pickup device 3. 
More specifically, a field identification pulse FLD (Fig. 
3A), a vertical sync pulse VD (Fig. 3B), a horizontal 
sync pulse HD (Fig. 3C), sensor gate pulses XG1 and 
XG2 (Figs.3D and 3E), and a transfer clock CK (Fig. 
3F) are supplied to the CCD image pickup device 3. 

A sensor gate pulse is supplied at a time point ti 
and charges are transferred from each pixel of the 
CCD image pickup device 3 to the vertical transfer 
register by the sensor gate pulse. The charges are 
transferred by the transfer clock shown in Fig. 3F. In 
this instance, the signals of two pixels in the vertical 
direction are mixed and sent to the vertical transfer 
register. The reading position can be shifted by one- 
half line by a combination of the sensor gate pulses 
XGS1 andXGS2. 

As shown by the frequency of the clock pulses in 
Fig. 3F, N lines of the CCD image pickup device 3 are 
transferred at a high speed. Although these N lines of 
the CCD image pickup device 3 are transferred at a 
high speed, the other lines of the CCD image pickup 
device 3 are transferred at the normal transfer speed 
starting from time point t2. The CCD image pickup de- 
vice 3 is then again transferred at a high speed from 
time point t3. The total number of lines which have 
been transferred for a period of time from time point 
tl to time point t4 corresponds to the number of lines 
of the PAL system, as represented in Fig. 2. The num- 
ber of lines for a period of time from time point t2 to 
time point t3 corresponds to the number of lines of the 
NTSC system, as represented by the middle open 
area in Fig. 2. The position in the vertical direction of 
the picture plane can be changed by the number N of 
lines which are transferred at a high speed. By setting 
the number N of lines which are vertically transferred 
in accordance with the shake in the vertical direction 
of the video camera, the vibration correction in the 
vertical direction is executed. 

Among the 582 effective lines of the CCD image 
pickup device 3 according to the PAL system, the 
charges of the 494 effective lines according to the 
NTSC system are transferred at a normal speed. The 
charges of remaining lines are transferred at a high 
speed. As a consequence of this two-speed charge 
transfer, a circular object Al will be displayed as a vert- 
ically elongated circular image A2, as shown in Fig. 4. 

In regard to the horizontal vibration correction, a 
signal SLof one line is stored in the line memory 14, 
as shown in Fig. 5A As shown in Fig. 5B, the time 
base of such a signal is converted and the resultant 
signal is read out. By performing this time base con- 



version, a ratio of the vertical and lateral lengths of 
the image which is displayed is corrected and the pic- 
ture plane is enlarged in the horizontal direction. By 
5 shifting the reading position of the line memory in ac- 
cordance with the shake of the video camera in the 
horizontal direction the vibration correction can be 
performed. 

In the video camera to which the invention is ap- 

10 plied, as mentioned above, the CCD image pickup de- 
vice 3 transfers the charges at a high speed during 
the vertical blanking period and sweeps out at a high 
speed. Therefore, considerably large charges flow 
from the vertical transfer register into the horizontal 

15 transfer register of the CCD image pickup device 3. 
Therefore, when a strong light is irradiated onto the 
CCD image pickup device 3, the charge amount will 
exceed the capacity of the horizontal transfer register 
and the overflow charges can easily flow in reverse 

20 to the vertical transfer register side. 

This is shown in Fig. 6, in which the photoelectric 
converting devices 41 are two-dimensionally ar- 
ranged to form the pixels of the ordinary CCD image 
pickup device. In each of the photoelectric converting 

25 devices 41 , the incident light is photoelectrical^ con- 
verted and the charges are supplied from the photo- 
electric converting devices 41 to a vertical transfer 
register 42. As represented by arrow al, the charges 
are transferred by the vertical transfer register 42 and 

30 sent to a horizontal transfer register 43. The charges 
are transferred, as represented by arrow d, by the 
horizontal transfer register 43 and are output to the 
appropriate circuitry of the video camera. 

When a large amount of charges are sent to the 

35 horizontal transfer register 43 through the vertical 
transfer register 42, the charges of the horizontal 
transfer register 43 will overflow. As represented by 
arrow b1, these overflow charges then flow in re- 
verse from the horizontal transfer register 43 to the 

40 vertical transfer register 42. 

According to an embodiment of the present in- 
vention, as shown in Fig. 7, a drain device 44 is pro- 
vided in parallel with the horizontal transfer register 
43. In operation of this embodiment, the charges from 

45 the photoelectric converting device 41 of each pixel 
are supplied to a vertical transfer register 42 and the 
charges are transferred from the vertical transfer reg- 
ister 42, as represented by arrow a2 to a horizontal 
transfer register 43. The charges are transferred from 

50 the horizontal transfer register 43, as represented by 
arrow c2, and output to the other circuitry of the video 
camera. 

Now, assuming that a large amount of charges 
are transferred to the horizontal transfer register 43 
55 through the vertical transfer register 42, the charges 
of the horizontal transfer register 43 will overflow as 
explained above. In this embodiment, however, the 
overflow charges flow into the drain 44 arranged in 
parallel with the horizontal transfer register 43, as 
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shown in Fig. 8. Therefore, it is possible to prevent the 
overflow charges from flowing in reverse from the 
horizontal transfer register 43 to the vertical transfer 
register 42. 

According to the embodiment of the invention, as 
shown in Figs. 5A and 5B, the time base in the hori- 
zontal direction is changed by the horizontal correct- 
ing circuit 14 and the picture plane in the horizontal 
direction is enlarged. In such a time-base conversion, 
the same data is repetitively read out from the line 
memory without changing the write clock and read 
clock and the data during such a period of time can 
be easily interpolated by management of the clock 
signals. When such a method is used, however, be- 
cause interpolation of the data is necessary a deteri- 
oration of the picture quality due to the interpolation 
filter occurs. 

According to an embodiment of the present in- 
vention, time-base conversion is executed by chang- 
ing the frequencies of the clocks in the writing and 
reading operation. Fig. 9 shows an example of the 
horizontal correcting circuit 14 to which the invention 
is applied, in Fig. 9, a video signal (luminance or chro- 
minance) is supplied to an input terminal 51 and fed 
to a line memory 52. An output of the line memory 52 
is supplied to a terminal 53Aof a switching circuit 53. 

A horizontal clock signal of frequency f H is sup- 
plied to an input terminal 54 and fed to a write clock 
generating circuit 55 and to a 1/N frequency dividing 
circuit 56. The output of the 1/N frequency dividing cir- 
cuit 56 is supplied to a phase comparing circuit 57 that 
produces an output fed to a voltage controlled oscil- 
lator (VXO) 58 through a low pass filter 61 . The output 
of the VXO 58 is supplied to a read clock generating 
circuit 59 and to. a sync generating circuit 62 and is 
also supplied to a 1/M frequency dividing circuit 60. 
The output of the 1/M frequency dividing circuit 60 is 
supplied to the other input of the phase comparing cir- 
cuit 57. In the phase comparing circuit 57, the phase 
of the clock signal that has been frequency divided by 
1/N is compared with the phase of the output of the 
VXO 58 that has been frequency divided by 1/M. On 
the basis of this phase comparison, the oscillating 
frequency of the VXO 58 is controlled. 

A phase-locked loop (PLL) is constructed by the 
frequency dividing circuits 56 and 60, the VXO 58, 
and the phase comparing circuit 57. The write clock 
and read clock of different frequencies can be formed 
by the PLL and, moreover, because the PLL is con- 
structed as described above, the write clock and read 
clock are line-locked. 

The output of the write clock generating circuit 55 
and the output of the read clock generating circuit 59 
are supplied to a memory controller 64. Ashift amount 
in the horizontal direction is also supplied to an input 
terminal 65 of the memory controller 64. The memory 
controller 64 controls the writing and reading opera- 
tions of the line memory 52 by the write clock signal 



from the write clock signal generating circuit 55 and 
the read clock from read clock generating circuit 59. 
A frequency ratio of the write clock and read clock is 
5 determined by the frequency dividing ratio N of the 
frequency dividing circuit 56 and the frequency divid- 
ing ratio M of the frequency dividing circuit 60. There- 
fore, the time-base conversion is realized, and the 
line in the horizontal direction is enlarged. The read- 
to ing position, or writing position, of the enlarged line is 
changed in accordance with a shift amount from the 
input terminal 65. Thus, the vibration correction in the 
horizontal direction is executed. 

The output of the sync generating circuit 62 is 
15 supplied to a fixed terminal 53B of a switching circuit 
53. The switching circuit 53 is switched to the other 
fixed terminal 53A connected to the output of line 
memory 52 for a video signal period of time. More 
specifically, the switching circuit 53 is switched from 
20 the terminal 53Aside to the terminal 53B side at a tim- 
ing of a sync signal and an output of the switching cir- 
cuit 53 is taken out from an output terminal 63. 

Defective pixels are almost invariably included in 
the large number of pixels forming the CCD image 
25 pickup device 3. As described above, the position in- 
formation of the defective pixels is accumulated into 
the defect position memory 31 and processes, such 
as interpolation and the like, are executed at the pos- 
itions of the defective pixels, thereby coping with the 
30 defective pixels. 

According to an embodiment of the present in- 
vention, as represented by the CCD image pickup de- 
vice in Fig. 10A, the addresses of the defective pixels 
Pn P2. Pa^re stored in the defect position memory 31. 
35 The addresses (Hn, Vn) are set to the absolute ad- 
dresses^, V^ with respect to the first defect P1 and 
are set to the absolute addresses (H 2 , H 3 ) with re- 
spect to the horizontal direction with regard to the 
subsequent defects P2 and P3, respectively, and are 
40 set in the relative addresses (V 2 , V 3 ) from the posi- 
tions of the preceding defect pixels with regard to the 
vertical direction. 

As shown in the circuit of Fig. 11, the addresses 
(Hn, Vn) of the defect positions are output from the 
45 defect position memory 31. The addresses (Hn, Vn) 
are supplied to the defect correction pulse generating 
circuit 32. A vibration amount Av in the vertical direc- 
tion is supplied from the vibration correction controller 
20 to the minus input of a signal summer 30 where it 
50 is subtracted from the vertical address Vn before be- 
ing fed to the defect correction pulse generating cir- 
cuit 32. Thus, the addresses (Hn, Vn - AV) which have 
been shifted in accordance with the vibration amount 
are formed. 

55 A defect correction pulse is generated at each 

position corresponding to the addresses (Hn, Vn - Av) 
and a switching circuit 71 in the signal processing cir- 
cuit 10 is controlled by the defect correcting pulses. 
That is, in case of a normal pixel, the switching circuit 
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71 ? :S set to a terminal 71 Aside. When the defect cor- 
rection pulse is generated, the switching circuit 71 is 
switched to a terminal 71 B side, and the pixel data 
that has been interpolated by a delay circuit 72 is out- 5 
put from the switching circuit 71. By adjusting the 
vertical addresses of all defective pixels by the 
amount of shift needed to correct for camera vibra- 
tions, as mentioned above, as shown in Figs. 10B and 
10C, the pixel defects can be accurately corrected 10 
along with the vibration correction. 

As described above, the position of the window 
of the optical detector 11 can be moved by the window 
correcting circuit 12 in correspondence to a shift 
amoOnt of the picture plane in the horizontal direction. 15 
That is, as shown in Fig. 12, a horizontal sync pulse 
HD (Fig. 13A) is fed in at an input terminal 81 to a load 
signal generating circuit 82, which generates a load 
pulse signal as shown in Fig. 13B, that is supplied to 
the counter 83. The counter 83 loads a value M in re- 20 
sponse to the pulses in load signal. The value M is set 
in accordance with the vibration amount in the hori- 
zontal direction and is counted by the counter 83 and 
the count output of the counter 83 is supplied to a de- 
coder 84. The position of a window W is determined 25 
by the decoder 84 on the basis of an output of the 
counter 83. The position of the window W is shifted 
in accordance with the value M which is loaded into 
the counter 83, namely, in accordance with the vibra- 
tion amount as shown in Figs. 1 3A and 1 3B. 30 

As described above, because the position of the 
window of the optical detector 11 is shifted in accor- 
dance with the vibration correction amount, there is 
a problem such that a phenomenon occurs in which 
the brightness is changed in spite of the fact that the 35 
picture plane is stationary. If it is assumed that, as 
shown in Fig. 14A, that vibration occurs in a state in 
which the position of an object Q coincides with the 
position of the window WD, and the position on the 
picture plane is corrected by performing vibration 40 
correction in accordance with an embodiment of the 
present invention. In this example as shown in Fig. 
14B, the actual picture plane does not move to per- 
form the necessary vibration correction, however, 
the result of the vibration correction is that the posi- 45 
tion of the window WD does not coincide with the pos- 
ition of the object Q. Therefore, the light amount in the 
window changes, although the photographed picture 
plane is stationary, due to the vibration correction and 
the whole brightness changes, thereby affecting the 50 
automatic focus control, the automatic exposure con- 
trols and the white balance control. 

To solve the problem according to an embodi- 
ment of the present invention, as shown in Fig. 14C, 
the position of the window WD is shifted in accor- 55 
dance with the vibration amount, so that the position 
of the object Q coincides with the position of the win- 
dow WD. Thus, the brightness detected in window 
WD does not change. 



Having described a specific preferred embodi- 
ment of the present invention with reference to the ac- 
companying drawings, it is to be understood that the 
invention is not limited to that precise embodiment, 
and that various changes and modifications may be 
effected therein by one skilled in the art without de- 
parting from the scope or the spirit of the invention as 
defined in the appended claims. 

For example, according to an embodiment of the 
present invention, the image pickup signal of the 
NTSC system is output by using a CCD image pickup 
device that has the number of lines corresponding to 
the PAL system. Nevertheless, any image pickup de- 
vice can be used so long as the number of lines of the 
image pickup device is greater than the number of 
lines of the image pickup signal to be output. In case 
the output of the image pickup signal is to be of the 
PAL system, a special image pickup device is used in 
which the number of lines is equal to 697, for exam- 
ple. 

According to the invention, an image pickup de- 
vice is used in which the number of lines is greater 
than the number of lines of the image pickup signal 
to be output and the vibration correction is executed 
by shifting the screen vertically using the surplus 
lines, so that the picture quality does not deteriorate. 
Because there is no need to add a mechanism to 
move a prism or the like, miniaturization and light 
weight of a video camera can be realized. 

As another feature of the invention, because the 
drain is arranged in parallel with the vertical transfer 
register of the image pickup device, it is possible to 
prevent the overflow charges from flowing in reverse 
flow the vertical transfer register of the image pickup 
device. In addition, because the position of the defec- 
tive pixel in the memory is shifted in accordance with 
the vibration amount, the information of the defective 
pixel can be made correspond to the shifted position 
to perform defective pixel interpolation. 

According to the invention, because the line is 
enlarged in the horizontal direction without using any 
interpolation filter, the picture quality does not deteri- 
orate. Moreover, because the position of the window 
used to obtain optica! information for camera control 
purposes is changed in accordance with the vibration 
amount, the optical information is adapted to the pho- 
tographed picture plane and the problem such that 
the whole brightness changes in spite of the fact that 
the picture plane is stationary is overcome. 



Claims 

1. A signal processing apparatus for correcting vi- 
bration effects in a video camera that produces 
an output signal in accordance with a known tel- 
evision standard, comprising: 

image pickup means having a number of 
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lines in a vertical direction that is greater than a 
number of lines of the known television standard 
to be output and thereby providing a number of 
surplus lies, said image pickup means including 
a horizontal transfer register and a vertical trans- 
fer register; 

vibration detecting means for detecting an 
amount of vibration of the video camera in the 
vertical direction; 

high-speed transfer control means for con- 
trolling said image pickup means to transfer 
charges at a high speed during a blanking period 
within a range of the number of the surplus lines 
that is equal to a difference between the number 15 
of lines of said image pickup means and the num- 
ber of lines of the television standard to be output 
in response to the vibration amount in the vertical 
direction detected by said vibration detecting 
means and for correcting vibration of the video 20 
camera in the vertical direction; and 

charge back-flow preventing means, ar- 
ranged in parallel with said horizontal transfer 
•register of said image pickup means, for prevent- 
ing a reverse flow of charges to said vertical 25 
transfer register upon high-speed transfer of said 
charges from said image pickup means by said 
high-speed transfer control means. 

A video signal processing apparatus for correct- 30 
ing vibration in a video camera producing video 
output signals in accordance with a known tele- 
vision system standard, the apparatus compris- 
ing: 

image pickup means having a plurality of 35 
pixels forming a number of lines in a vertical di- 
rection that is greater than a number of lines in 
the known television system standard and there- 
by producing a number of surplus lines, at least 
some of said pixels at known positions in said inrv 40 
age pickup means are defective; 

vibration detecting means for detecting an 
amount of vibration in the vertical direction of the 

video camera; 

high-speed transfer control means for 45 
transferring charges of said image pickup means 
at a high speed during a video blanking period 
within a range of the number of surplus lines 
equal to a difference between the number of lines 
of said image pickup means and the number of so 
lines of the television standard system, in re- 
sponse to the vibration in the vertical direction 
obtained by said vibration amount detecting 
means and for correcting the vibration in the vert- 
ical direction; 55 

memory means for storing position infor- 
mation of each of the defective pixels in said im- 
age pickup means; and 

defect correcting means for correcting de- 



fective pixel positions in accordance with said de- 
fective pixel position information and the number 
of lines which are transferred at a high speed for 
5 a vibration correction. 

3. The video signal processing apparatus according 
to claim 2, wherein said image pickup device 
means includes a horizontal transfer register and 
a vertical transfer register and further compris- 
ing: 

charge back-flow preventing means ar- 
ranged in parallel with said horizontal transfer 
register of said image pickup means for prevent- 
ing a reverse flow of charges to said vertical 
transfer register upon high-speed transfer of said 
image pickup means. 

4. The video signal processing apparatus according 
to claim 2, wherein said vibration detecting 
means detects vibration amounts in the horizon- 
tal and vertical directions, and said defect cor- 
recting means corrects the positions of the defec- 
tive pixels in accordance with the defect position 
information and the vibration amounts in the vert- 
ical and horizontal directions and further com- 
prises: 

line memory means containing a video sig- 
nal having vibration in the vertical direction cor- 
rected, said line memory means being written to 
by a write clock signal and read out by a read 
clock signal, in which said read clock signal has 
a frequency lower than a frequency of said write 
clock signal, thereby performing an enlargement 
in the horizontal direction of the video signal; and 
line memory control means for correcting 
the vibration in the horizontal direction by shifting 
the reading position or writing position of said line 
memory in accordance with the detected vibra- 
tion amount in the horizontal direction. 

5. A video signal processing apparatus for correct- 
ing vibration in a video signal, comprising: 

image pickup means having a number of 
lines in a vertical direction that is greater than a 
number of lines of a television standard system of 
the video signal and thereby forming a number of 
surplus lines; 

vibration detecting means for detecting an 
amount of vibration in horizontal and vertical d'h 
rections relative to said image pickup means; 

high-speed transfer control means for 
transferring charges on said image pickup means 
at a high speed during a video signal blanking 
period within a range of the number of surplus 
lines equal to a difference between the number 
of lines of said image pickup means and the num- 
ber of lines of the television standard system in 
response to the vibration amount in the vertical 
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direction detected by said vibration detecting 
means and for correcting the vibration in the vert- 
ical direction; 

line memory means containing a video sig- 5 
nal having vibration in the vertical direction cor- 
rected, said line memory means being written to 
by a write clock signal and read out by a read 
clock signal, in which said read clock signal has 
a frequency lower than a frequency of the write 10 
clock signal, thereby performing a magnification 
in the horizontal direction of the video signal; and 

line memory control means for line-locking 
the write clock and the read clock, for setting a 
frequency ratio of the write clock and the read is 
clock in accordance with a magnification ratio in 
the horizontal direction, and for shifting the read- 
ing position or writing position of said line memory 
means, thereby correcting vibration in the hori- 
zontal direction. 20 

6. The video signal processing apparatus according 
to claim 5, further comprising: 

memory means for storing position infor- 
mation of defective pixels arranged in said image 25 
pickup means; and 

defect correcting means for correcting 
positions of defective pixels in said memory 
means in accordance with the defect position in- 
formation and the vibration amounts in the hori- 30 
zontal and vertical directions. 

7. A video signal processing apparatus for correct- 
ing vibration effects in a video signal produced by 

a video camera, comprising : 35 

image pickup means having a number of 
horizontal lines arranged in a vertical direction 
that is greater than a number of lines of a televi- 
sion standard system of the video signal pro- 
duced by the video camera and thereby produc- 40 
ing a number of surplus lines; 

vibration detecting means for detecting an 
amount of vibration in the horizontal and vertical 
directions; 

high-speed transfer control means for 45 
transferring data from said image pickup means 
at a high speed during a blanking period of the 
video signal within a range of the number of sur- 
plus lines which is equal to a difference between 
the number of lines of said image pickup means so 
and the number of lines of the television system 
in accordance with a vibration in the vertical di- 
rection detected by said vibration detecting 
means and for correcting the vibration in the vert- 
ical direction; J 55 

line memory means connected to receive 
a video signal after vibration in the vertical direc- 
tion is corrected, said line memory means being 
written to by a write clock signal and read out by 



a read clock signal, wherein said read clock signal 
has a frequency lower than a frequency of the 
write clock signal, thereby performing an en- 
largement in the horizontal direction of the video 
signal; 

line memory control means for correcting 
the vibration in the horizontal direction by shifting 
a reading position or a writing position of said line 
memory means; 

optical detecting means for detecting opti- 
cal parameters in a window formed relative to 
said number of horizontal lines of said image pick- 
up means; and 

window setting means for correcting the 
position of said window in accordance with the vi- 
bration amount so as not to change the relative 
position for the video signal after the vibration 
has been corrected. 
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